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Abstract 



In this paper, we focus on the following testing problem: assume that we are 
given observations of a real- valued signal along the grid 0, 1, iV — 1, corrupted by 
the standard Gaussian noise. We want to distinguish between two hypotheses: (a) 
the signal is a nuisance - a linear combination of d n harmonic oscillations of given 
frequencies, and (b): signal is the sum of a nuisance and a linear combination of a 
given number d s of harmonic oscillations with unknown frequencies, and such that 
the distance (measured in the uniform norm on the grid) between the signal and 
the set of nuisances is at least p > 0. We propose a computationally efficient test 
for distinguishing between (a) and (b) and show that its "resolution" (the smallest 
value of p for which (a) and (b) are distinguished with a given confidence 1 — a) 



is O ^\/ln(iV/a) /NJ , with the hidden factor depending solely on d n and d s and 
independent of the frequencies in question. We show that this resolution, up to a 
factor which is polynomial in d n , d s and logarithmic in N, is the best possible under 
circumstances. We further extend the outlined results to the case of nuisances and 
signals close to linear combinations of harmonic oscillations, and provide illustrative 
numerical results. 



In this paper, we address the detection problem as follows. A signal (two-sided sequence 
of reals) x is observed on time horizon 0,1, N — 1 according to 



where £ ~ A/"(0, In) is the white Gaussian noise and Zq 1 = [z ; ...;zn-i\- Given y we 
want to distinguish between two hypotheses: 

• Nuisance hypothesis: x G Hq, where Hq is comprised of all nuisances - linear 
combinations of d n harmonic oscillations of given frequencies; 
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• Signal hypothesis: x G Hi(p), where H\(p) is the set of all sequences x representable 
as s + u with the "nuisance component" u belonging to Hq and the "signal compo- 
nent" s being a sum of at most d s harmonic oscillations (of whatever frequencies) 
such that the uniform distance, on the time horizon in question, from x to all nui- 
sance signals is at least p: 

min ll^" 1 - ^ _1 Hoo > p. 

z&H 

We are interested in a test which allows to distinguish, with a given confidence 1 — a, 
between the above two hypotheses for as small "resolution" p as possible. 

An approach to this problem which is generally advocated in the signal processing 
literature is based on frequency estimation. The spectrum of the signal is first estimated 
using noise subspace methods, such as multiple signal classification (MUSIC) [10, 11], 
then the nuisance spectrum is removed from this estimation and the decision is taken 
whether the remaining "spectral content" indicates the presence of a signal or is a noise 
artifact (for detailed presentation of these techniques see [12, 5]). To the best of our 
knowledge, no theoretical bounds for the resolution of such tests are available. A different 
test for the case when no nuisance is present, based on the normalized periodogram, 
has been proposed in [3]. The properties of this test and of its various modifications 
were extensively studied in the statistical literature (see, e.g., [13, 4, 1, 5]). However, 
theoretical results on the power of this test are limited exclusively to the case of sequence 
x being a linear combination of Fourier harmonics e 2mkt / N ; k = 0, 1, N — 1 under signal 
hypothesis. 

In this paper we show that a good solution to the outlined problem is offered by an 
extremely simple test as follows. 

Let F N u = {^ w Y.?=~o 1 u t exp{2nikt/N}}^ : C N ^ C N be the Discrete 
Fourier Transform. Given the observation y, we solve the convex optimization 
problem 

Opt(y) = mm {\\F N (y - z^ 1 )^ : z E H } 

and compare the optimal value with a threshold gjv(a) which is a valid upper 
bound on the 1 — a-quantile of ||.F/v£||oo, a G (0, 1) being a given tolerance: 

Prob^jv-(o,/ N ) {Halloo > <?7v(a)} < a. 

If Opt(y) < qN^Ci), we accept the nuisance hypothesis, otherwise we claim 
that a signal is present. 

It is immediately seen that the outlined test rejects the nuisance hypothesis when it is true 
with probability at most a l . Our main result (Theorems 3.1) states that the probability 
to reject the signal hypothesis when it is true is < a, provided that the resolution p is not 
too small, specifically, 

p>C{d n + d s )^j\n{N/a)/N (!) 

lr This fact is completely independent of what the nuisance hypothesis is - it remains true when Hq is 
an arbitrary set in the space of signals. 
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with an appropriately chosen universal function C(-). 
Some comments are in order. 



• We show that in our detection problem the power of our test is nearly as good as 
it can be: precisely, for every pair d n , d s and properly selected H , no test can 
distinguish (1 — a)-reliably between H and Hi(p) when p < 0(l)d s ^J\n(l/a) /N 
from now on, 0(1) 's are appropriately chosen positive absolute constants. 

• We are measuring the resolution in the "weakest" of all natural scales, namely, via 
the uniform distance from the signal to the set of nuisances. When passing from the 
uniform norm to the normalized Euclidean norm | x^ -1 ^ = H^^I^/x/iV < Hx^Hoo? 
an immediate lower bound on the resolution which allows for reliable detection 
becomes 0(1) ^/ln(l/ a) / TV . In the case when, as in our setting, signals obeying H 
and Hi(p) admit parametric description involving K parameters, this lower bound, 
up to a factor logarithmic in N and linear in K, is also an upper resolution bound, 
and the associated test is based on estimating the Euclidean distance from the 
signal underlying the observations to the nuisance set. Note that, in general, the 
| ■ | 2 -norm can be smaller than || ■ by a factor as large as yN, and the fact that 
"energy-based" detection allows to distinguish well between parametric hypotheses 
"separated" by 0(J\n(N/ a) /N) in | • | 2 norm does not automatically imply the 

possibility to distinguish between hypotheses separated by 0(^J\n(N/a)/N) in the 
uniform norm 2 . The latter possibility exists in the situation we are interested in 
due to the particular structure of our specific nuisance and non-nuisance hypotheses; 
this structure allows also for a dedicated non-energy-based test. 

• For the sake of definiteness, throughout the paper we assume that the observation 
noise is the standard white Gaussian one. This assumption is by no means critical: 
whatever is the observation noise, with q^ict) defined as (an upper bound on) the 
(1 — a)-quantile of ||-F/v£||oo, the abovetest (1 — a) -reliably distinguishes between the 
hypotheses H and Hi(p), provided that p > C(d n + d s )qN(a) / 'y/N ' . For example, 
the results of Theorems 3.1 and 3.2 remain valid when the observation noise is of 
the form £ = {£ t = X^_oo IrVt-r} 1 ^ 1 with deterministic j T , J2 T |7t| < 1; an d 
independent r\ t ~ Af(0, 1). 

• The main observation underlying the results on the resolution of the above test 
is as follows: when x is the sum of at most d harmonic oscillations, H-Fjv^Hoo ^ 
0((i)\/iV : ||x^~ 1 || 00 with some universal positive function C(d). This observation 
originates from [8] and, along with its modifications and extensions, was utilized, 
for the time being in the denoising setting, in [9, 2, 6, 7]. It is worth to mention that 
it also allows to extend, albeit with degraded constants, the results of Theorems 3.1 
and 3.2 to multi-dimensional setting. 

2 Indeed, let Ho state that the signal is 0, and Hi(p) state that the signal is > p at t — and is zero for 
all other Vs. These two hypotheses cannot be reliably distinguished unless p > O(l), that is, the || • 
resolution in this case is much larger than 0(y/\n(N/a) /N). 
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The rest of this paper is organized as follows. In section 2 we give a detailed description 
of the detection problems (-Pi), (P2), (N\) and (N 2 ), we are interested in (where (P2) is 
the problem we have discussed so far). Our test is presented in section 3 where we also 
provide associated resolution bounds for these problems. Next in section 4 we present 
lower bounds on "good" (allowing for (1 — a)-reliable hypotheses testing) resolutions, 
while in section 5 we present some numerical illustrations. The proofs of results of sections 
3 and 4 are put into section 6. 

2 Problem description 

Let S stand for the space of all two-sided real sequences z = {z t G R}^.^. Assume that 
a discrete time signal x G S is observed on time horizon < t < N according to 

y = x$- 1 +£, £~M(0,I N ), (1) 

where (and from now on) for z G S and integers p < q, z^ stands for the vector 

In the sequel, we are interested in the case when the signal is a linear combination of 
a given number of harmonic oscillations. Specifically, let A stand for the shift operator 
on S: 

(Az) t = z t -i, x G S. 

Let Qd be the set of all unordered collections w = {ui, ...,Ud} of d reals which are 
"symmetric mod 2tt" meaning that for every a, the number of u^s equal, modulus 2tt, to 
a is exactly the same as the number of Wj's equal, modulus 2n, to —a. We associate with 
w G Qd the real algebraic polynomial 

d 

Pw(C) = H( l ~ exp{«^}C) 
£=1 

and the subspace S[w] of S, comprised of x G S satisfying the homogeneous finite- 
difference equation 

p w (A)x = 0. (2) 
In other words, <S[{wi, ...,Ud}} is comprised of all real two-sided sequences of the form 

d 

x t = Y1 cos ( w ^) + Qt(t) sm(uet)} 
1=1 

with real algebraic polynomials pe(-), qe(-) of degree < me, where me is the multiplicity, 
mod27r, of bJe in w. We set 

s d = IJ 

wen d 

Remark 2.1 In what follows, we refer to the reals Ui constituting w G Qd as to fre- 
quencies of a signal from <S[w]. A reader would keep in mind that the number of "actual 
frequencies" in such a signal can be less than d: frequencies in w different from mod 2n 
and 7rmod27r go in "symmetric pairs" (u,u' = — wmod27r), and such a pair gives rise to 
a single "actual frequency." 
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Given a positive integer N, real e > 0, and w G Qd, we set 



S N > e [w] = {xeS: || \p w (A)x]^- 1 \\ o0 < e}. 
Finally, we denote iS^' e the set 

S»* = U 5^[w]. 

When N is clear from the context, we shorten the notations iS^'^w], <S^' e to iS e [w] and 
S d , respectively. 

In the definitions above, it was tacitly assumed that d is a positive integer. It makes 
sense to allow also for the case of d = 0. By definition, Qq is comprised of the empty 
collection w = and p$(C) = 1- With this convention, £^[0] = {x G S : 1 1 ^ctq^ 1 1 1 — e }- 

Observe that the family S^ ,€ , d > 2, is quite rich. For instance, it contains "smoothly 
varying signals" (case of Wi = mod 2tt), along with "fast varying" - amplitude-modulated 
and frequency-modulated signals (see [2, 6] for more examples). 

We detail now the hypothesis testing problems about the sequence x via observation 
y given by (1). In what follows d s and d n are given positive integers, and p, e n , e s are 
given positive reals. 

(Pi) The "basic" hypothesis testing problem we consider is that of testing of a simple 
nuisance hypothesis {x = 0} against the alternative that a signal x G Sd a "is 
present," meaning that the uniform norm of the signal on the observation window 
[0, ...,N — 1] exceeds certain threshold p > 0. In other words, we consider the 
following set of hypotheses: 

H = {x = 0}, 
H x {p) = {xES ds : Hatf-loo >p}- 

(P2) We suppose that x G S decomposes into "signal" and "nuisance": 

x = s + u, 

where s is the signal of interest and a nuisance u belongs to a subspace «5[w], 
assumed to be known a priori. We consider a composite nuisance hypothesis that 
x is a "pure nuisance", and the alternative (signal hypothesis) that useful signal 
s does not vanish, and the deviation, when measured in the uniform norm on the 
observation window, of "signal+nuisance" from the nuisance subspace is at least 
p > 0. Thus we arrive at the testing problem: given w G Qd n decide between the 
hypotheses 

{x = u G «S[w]}, 

j x = u + s : u e <S[w], s G Sd B , 1 
1 such that min 2 {|| [x — z]^" 1 ]]^ : z G <S[w]} > p. J 

Clearly, problem (P x ) is a particular case of (P 2 ) with d n = (and thus S dn = {0} 
is a singleton). 



Ho = 
Hi(p) = 



5 



(iVi) Given w G fi^, consider the nonparametric nuisance hypothesis that the nuisance 
u G S^fW] with some known w. The signal hypothesis is that the useful signal 
s G Sd s is present, and x = s + u deviates from the nuisance set on the observation 
window by at least p > in the uniform norm: 



Hi(p) 



H = {x = ueS N > e "[w}}, 

j x = u + s : u e S N ' en [w], s G S ds , 
1 such that min 2 {||[x - ^]^ _1 ||oo : z G S N > en [w]} > p. 



{N 2 ) The last decision problem is a natural extension of (Nx): we consider the prob- 
lem of testing a nonparametric nuisance hypothesis against a nonparametric signal 
alternative that the useful signal s G S^' es is present: 



H = {x = u E S N ' e " [w] } 
Hx{p) = 



x = u + s: u G S N ' en [w], s G «S^' es , 



and such that min 2 {||[a; - z]^ 1 || 0O : z G ^^"[w]} > p. j 
Note that problem (Ni) is a particular case of (AT 2 ) with e s = 0. 

In the sequel, we refer to the sequences obeying H (resp., Hi = H\(p)) as nuisance (resp. 
signal) sequences. 

Let ip(-) be a test, i.e. a Borel function on H N taking values in {0, 1}, which receives 
on input observation (1) (along with the data participating in the description of Hq and 
H\). The event {<p{y) = 1} corresponds to rejecting the hypothesis Hq, while {<p{y) = 
0} implies that Hi is rejected. The quality of the test is characterized by the error 
probabilities - the probabilities of rejecting erroneously each of the hypotheses: 

€ (lp;H ) = sup Prob x {(p(y) = 1}, e^tp; H^p)) = sup Prob x {(p(y) = 0}. 

We define the risk of the test as 

Risk(y9, p) = max {e (ip>; Ho)^^; H^p))} . 

Let a G (0, 1/2) be given. In this paper we address the following question: for the testing 
problems above, what is the smallest possible p such that one can distinguish (1 — a)- 
reliably between the hypotheses H and Hi = H\(p) via observation (1) (i.e., is such 
that Risk(y9,p) < a). In the sequel, we refer to such p as to a-resolution in the testing 
problem in question, and our goal is to find reasonably tight upper and lower bounds on 
this resolution along with the test underlying the upper bound. 



3 Basic Test and Upper Resolution Bounds 

In this section, we present a simple test which provides some upper bounds on the a- 
resolutions in problems (Pi) - (iV 2 ). 
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Preliminaries. Let Tn = {fi T = exp{2mr/N} : < r < iV — 1} be the set of roots of 
1 of degree N, and let Fn '■ C N — > C(Tn) be the normalized Fourier transform: 



I N-l 



[F N fW = -t= E /*/**, /i 



e rv (3) 



Note that (3) can also be seen as a mapping from S to C(rjv). 

Given a tolerance a G (0, 1/2), let gAr(a) be the (1 — a)-quantile of HF/v^Hoo, so that 

Prob^jv-(o,/ N ){||-PivCI|oo > gjv( a )} < a. 
In the sequel we use the following immediate bound for gjv(-) : 



inf < s <i max 
inf < s <i max 



N-2 



Erflnv (f 4 j , y 2(1 _ S)Q 
Erflnv (f ) , 



, for iV even, 
, for iV odd 



Wo) (4) 



Here a x 6 means that the ratio a/6 is in-between positive absolute constants, and 
Erflnv(a) is the inverse error function: -h= J^ nv ^ a ) e~ s ^ 2 ds = a. 



The test we are about to consider (and which we refer to as basic test in the sequel) is 
as follows: 

1. given y, we solve the convex optimization problem 



Opts(y) = mm \\F N (y - (5) 

where the set Z is defined according to 

!{0}, for problem (Pi), 
«S[w], for problem (P2), (6) 
5 e [w], for problems (Ni) and (N 2 ). 

2. We compare Opt z (y) to oat(q;), where a is a given tolerance: if Opt < ?at(o;), we 
accept H , otherwise we accept Hi. 

We describe now the properties of the basic test as applied to problems (-Pi), (P2), (Ni) 
and (N 2 ). 

Theorem 3.1 The risk of the basic test as applied to problems {Pi), (P2) is bounded by 
a, provided that d* = d n + d s > and 



P > 0(l)dl \n{2d,)q N {a)N- 1/2 = 0(1)^ ln(2d*) ^N' 1 In (N/a) (7) 
with properly chosen positive absolute constants 0(1). 

The result for the nonparametric problems (Ni) and (N 2 ) is similar: 
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Theorem 3.2 The risk of the basic test as applied to problems (Nx), (N%) is bounded by 
a, provided that = d n + d s > 0, p satisfies (7) with properly selected 0(1) 's and, in 
addition, e n and e s are small enough, specifically, 

N d "+h n + N d ° + le s < 0(l)q N (a) (8) 
with properly selected positive absolute constant 0(1). 

The proofs of Theorems 3.1, 3.2 are relegated to section 6. 

Theorems 3.1 and 3.2 provide us with upper resolution bounds independent of the 
frequencies constituting w and w. When e n , e s are "small enough," so that (8) holds 
true (we refer to the corresponding range of problems' parameters as the parametric 
zone), our upper bound on a-resolution in all testing problems of interest is essentially 
the same as in the case of e n = e s = — it is C(d n + d s )^J\n(N/a)/N with the factor 
C(d) = 0(l)d 3 \n(2d) depending solely on d. 



4 Lower Resolution Bounds 

The lower resolution bounds of this section complement the upper bounds of section 3. 
We start with the parametric setting (Pi) and (P2). Through this section, Ci(d n ,d s ) are 
properly selected positive and monotone functions of their arguments. 

Proposition 4.1 Given integers d n > 0, d s > 1, and s real a £ (0,1/2), consider 
problems (Pi) and (P2) with the data d n (d n = in the case of problem (Pi)), d s , a and 

w = {0, ...,0}. Then for properly selected co(d n , d s ) and all N > co(d n ,d s ) the a-resolution 
p in the problems (Pi) and (P 2 ) associated with the outlined data admits the lower bound 

0(l)d s ^/\n(l/a)/N. 

We see that in the problem (Pi) a-resolution grows with d s at least linearly. Note 
that by Theorem 3.1, this growth is at most cubic (more precisely, it is not faster than 
0(l)d^ln(d s )). Beside this, we see that the upper bounds on a-resolution for problems 
(Pi) and (P2) stemming from Theorem 3.1 and associated with the basic test coincide, 
within a factor depending solely on d n ,d s ,N and logarithmic in N, with lower bounds on 
a-resolution. 

We have the following lower bound on the a-resolution in the problem (-/Vi). 
Proposition 4.2 Given integers d n > 0, d s > 2 and reals a £ (0, 1/2), e n > 0, consider 

dn 

problem (Nx) with the data d n , d s , N, e n , a and w = {0, 0}. Then for properly selected 
Ci(d n , d s ) > depending solely on d n , d s and for all N satisfying 

N>c (d m d s ), (9) 

the a-resolution p*(a) in the problem (Nx) associated with the outlined data satisfies: 
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(i) in the range < e n < Ci(d n) d s )N dn 1/2 y / ln(l/a), 

p*(a) > c 2 (d n ,d s )^\n(l/a)/N; 

(ii) in the range 

c 3 K,4)iV- d ™- 1/2 V / ln(l/a) < e n < Cl (d n , d a )Ny/U^), (10) 



P*(a) > c 4 (d„,d s ) [e n iV^+ 1 / 2 [lii(l/a)]- 1 / 2 ] 2d " +3 y/N-Hn(l/a). 

In the case of the problem (N 2 ) we have a similar lower bound on a-resolution when 
en < e s . 

Proposition 4.3 Given integers d n > 0, d s > 2 and reals a £ (0, 1/2), e n > 0, consider 

problem (N 2 ) wit/i i/ie data d n , d s , iV ; e n; e S; a and w = {0, ...,0}. 

Assume that < e n < e s . Then for properly selected Ci(d n , d s ) > depending solely on 
d n ,d s and all N > co(d n ,d s ) the a-resolution p*(a) in the problem (N 2 ) associated with 
the outlined data satisfies: 

(i) in the range < e s < Ci(d n , d s )N~ ds ~ 1 / 2 \J\n(l / a) , 



P*{a) > c 2 (d n ,d s )^J\n(l/a)/N; 

(ii) in the range 

c 3 (d„, d s )N- d ^ 2 ^\n(l/a) <e s < Cl (d n , d 8 )yj\n(l/a), (11) 



PM) > c,(d n ,d s ) [e s A^ +1 /2[ ln(1/a)] -i/2] «.V ^-Mn(l/a 
> c 5 (d n ,d s )ef^ (\n(l/a))A . 



(12) 



The results of items (i) in Propositions 4.2 and 4.3 say that when d n , d s are fixed, N 
is large and e n , e s are small enough so that the problem parameters are in the parametric 
zone (i.e., (8) holds), Theorem 3.2 describes "nearly correctly" (i.e., up to factors de- 
pending solely on d n ,d s ,N and logarithmic in N) the a-resolution in problems (iVi) and 
(N 2 ): within such a factor, the a-resolution for problems (Ni), (N 2 ), same as for problems 

(Pi), (P 2 ), is \Jha.(l / a) / N . Besides, items (ii) in Propositions 4.2 and 4.3 show that when 
(e n ,e s ) goes "far beyond" the range (8), the a-resolution in problems (Ni), (N 2 ) becomes 



"much worse" than ym(l/a)/iV. 

5 Numerical Results 

Below we report on preliminary numerical experiments with the basic test. 
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5.1 Problem (N{) 



The goal of the first series of experiments was to quantify "practical performance" of the 
basic test as applied to problem (N^. 

Organization of experiments. We consider problem (Ni) on time horizon < t < N 
for N £ {128, 512, 1024} with reliability threshold a = 0.01. In these experiments d n = 4, 
the frequencies in w are selected at random, e n = 0.01, and d s = 4 (note that N and e n are 
deliberately chosen not to satisfy (8)). As explained in section 3, the above setup data 
specify the basic test for problem (Ni), and our goal is to find the "empirical resolution" 
of this test. To this end, we ran 10 experiments as follows. In a particular experiment, 

• We draw at random w £ £4, a shift s £ «S[w] and basic nuisance u £ <S e "[w]. 

• We generate a "true signal" x according to x\ = As + u, where A > is (nearly) 
as small as possible under the restriction that with x = X\, the basic test "rejects 
reliably" the hypothesis Hq, namely, rejects it in every one of 15 trials with x = x\ 
and different realizations of the observation noise £, see (l) 3 . 

• For the resulting A, we compute p = min_ \\x\ — «||oo, which is the output of 

ueS e »[w] 

the experiment. We believe that the collection of 10 outputs of this type gives a 
good impression on the "true resolution" of the basic test. As a byproduct of an 
experiment, we get also the || • H^-closest to x\ point u x £ cS e "[w]; the quantity 
r = \\x\ — u x \\2/t/N can be thought of as a natural in our context "signal-to-noise 
ratio." 

The results are presented in table 1. We would qualify them as quite compatible with 
the theory we have developed: both empirical resolution and empirical signal-to-noise 
ratio decreases with iV as iV -1 / 2 . The "empirically observed" resolution p for which the 
basic test (1 — a)-reliably, a = 0.01, distinguishes between the hypotheses H and Hi(p) 
associated with problem (Ni) is ~ 6^J\n(N/a)/N. 

Comparison with MUSIC. An evident alternative to the basic test is (a) to apply the 
standard MUSIC algorithm [ ] in order to recover the spectrum of the observed signal, 
(b) to delete from this spectrum the "nuisance frequencies", and (c) to decide from the 
remaining data if the signal of interest is present. Our related numerical results are, to the 
best of our understanding, strongly in favor of the basic test. Let us look at figure 1 where 
we present four MUSIC pseudospectra (we use pmusic function from MATLAB Signal 
Processing Toolbox) of the observations associated with signals x obeying the hypothesis 
H\(p) (magenta) and of the observations coming from the || • ||oo-closest to x nuisance (i.e., 
obeying the hypotheses H ) u x (blue), p was chosen large enough for the basic test to 
accept reliably the hypothesis Hi(p) when it is true. We see that while sometimes MUSIC 

3 Since a run of the test requires solving a nontrivial convex program, it would be too time-consuming 
to replace 15 trials with few hundreds of them required to check reliably that the probability to reject 
Hq, the signal being x\, is at least the desired 1 — a = 0.99. 
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Experiments with N = 128: 



Experiment jj= 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


Mean 


MeanxiV 1 / 2 


Resolution 


1.10 


1.58 


1.52 


1.51 


2.28 


1.85 


1.12 


1.92 


1.12 


1.82 


1.58 


17.9 


Signal/noise 


0.70 


1.09 


0.94 


0.95 


1.36 


1.03 


0.77 


1.06 


0.69 


1.10 


0.97 


11.0 


Experiments with N = 512: 


Experiment jj= 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


Mean 


MeanxiV 1 / 2 


Resolution 


0.79 


1.30 


1.31 


0.79 


0.79 


0.79 


0.48 


0.79 


0.81 


0.48 


0.83 


18.8 


Signal/noise 


0.44 


0.71 


0.74 


0.43 


0.43 


0.44 


0.30 


0.50 


0.44 


0.34 


0.48 


10.8 


Experiments with N = 1024: 


Experiment # 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


Mean 


MeanxiV 1 / 2 


Resolution 


0.60 


0.92 


0.36 


0.58 


0.46 


0.35 


0.36 


0.56 


0.42 


0.59 


0.52 


16.6 


Signal/noise 


0.32 


0.56 


0.24 


0.41 


0.31 


0.27 


0.26 


0.43 


0.26 


0.39 


0.35 


11.0 



Table 1: Problem (JVi) with d = d s = 4, a = e = 0.01. 

pseudospectrum indeed allows to understand which one of the hypotheses takes place (as 
it is the case in the example (d)), "MUSIC abilities" in our context are rather limited 4 . 
For example, it is hard to imagine a routine which would attribute magenta curves in the 
examples (a-c) to signals, and the blue curves — to the nuisances. 

5.2 Comparison with Energy Test 

Our objective here is to compare the resolution of the basic test to that of the test 
which implements the straightforward idea of how to discover if the signal x underlying 
observations (1) does not belong to a given nuisance set U C S. The test in question, 
which we refer to as energy test, is as follows: given a tolerance a and an observation y, 
we solve the optimization problem 

Opt(y) = inf -Wy-u^X 
and compare the optimal value with the (1 — a)-quantile 

p N (a) : Prob € „jy/-(o,j>r){||£||2 > PvO)} = a 

of the ^-distribution with iV degrees of freedom. If Opt(y) > p^(a), we reject the 
nuisance hypothesis H stating that x G U, otherwise we accept the hypothesis. Note 
that the basic test is of a completely similar structure, with \\F N (y — Uq -1 )^ in the role 
of \\y — ^o^^ 1 111 an d <?Ar( a ) i n the role of p^{a). It is clear that the energy test rejects H 
when the hypothesis is true with probability at most a (cf. item 1° in section 6.2). In 
order to reduce the computational burden, we restrict this test comparison to the simplest 



4 It should be noted that MUSIC is designed for a problem different from (and more complex than) 
the detection we arc interested in, and thus its weakness relative to a dedicated detection test does not 
harm algorithm's well-established reputation. 
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Figure 1: MUSIC pseudospectra as built by MATLAB function pmusic(-,8)^. Magenta: 
Signal plus nuisance; Blue: pure nuisance; Red bars: nuisance frequencies (d = 4 elements 
in w correspond to 2 "actual" frequencies). 

^In the present setup, w U w = {±u>j, 1 < j < 4}, which requires the pmusic parameter p to be set to 8. 
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case of U = {0}, i.e., the case of problem (Pi). Let us start with some theoretical analysis. 
Given a natural d s > and a real p > 0, consider the signal hypothesis Hi(p) stating 
that the signal x underlying observations (1) satisfies H^o^Hoo > P and that x t is a real 

d 

algebraic polynomial of degree < d — 1 of £ £ Z, meaning that x G «S[o7^7o]- Observe 
that with our U = {0}, Opt(y) is nothing but 

It follows that the hypothesis Ho is accepted whenever the event 

lieii 2 2 +2^- i +ii^- i n 2 2 <p iV (Q ! ) 

takes place. Now, from the standard results on the \ 2 distribution it follows that for 
every a G (0, 1), for all large enough values of N with properly chosen absolute constants 
it holds 

Pmb^ Mi0>lN) {p N (a) - U\\i > 0(l)^N\n(l/a)} > 0(1), 

whence also 

Prob^ Wjv) [{p N (a) - > 0{l)sjNUl/a)} U {fx"' 1 < 0}} > 0(1). 

As a result, whenever x G S satisfies — 0(1) \Jn ln(l/a), the probability to 

accept H , the true signal being x, is at least 0(1), provided that iV is large enough. On 
the other hand, for a given d s and large N there exists a polynomial x of degree d s — 1 
such that Ijs^^ 1 !^ < d~ l N~ l l 2 \\xQ~ l H^, see the proof of Proposition 4.1. It immediately 
follows that with cf s > 1 and (small enough) a > fixed, the energy test cannot distinguish 
(1 — a)-reliably between the hypotheses H and Hi(p), provided that 

p = 0(l)d s [N- 1 \n(l/a)} 1/4 (13) 

and iV is large enough. In other words, with d s and (small enough) a fixed, the resolution 
of the energy test in problem (Pi) admits, for large N, the lower bound (13). Note that 
as iV grows, this bound goes to as iV -1//4 , while the resolution of the basic test goes to 
as A r ~ 1 / 2 y / ln(A^) (Theorem 3.1). We conclue that the basic test provably outperforms 
the energy test as N — > oo. The goal of the experiments we are about to report was to 
investigate this phenomenon numerically. 



Organization of experiments. In the experiments to follow, the basic test and the 
energy test were tuned to 0.99-reliability (a = 0.01)) and used on time horizons iV G 
{256,1024,4096}. For a fixed N, and every value of the "resolution parameter" p from 
the equidistant grid on [0,4] with resolution 0.05, we ran 10,000 experiments as follows: 

• we generate z G <S[w], and specify signal x as pz/\\z _1 ||oo; 

• we generate y according to (1) and run on the observations y the basic test and the 
energy test. 
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For every one of the tests, the outcome of a series of 10,000 experiments is the empirical 
probability p of rejecting the nuisance hypothesis Hq (which states that the signal under- 
lying the observations is identically zero). For p = 0, p is the (empirical) probability of 
false alarm (rejecting H when it is true), and we want it to be small (about a = 0.01). 
For p > 0, p is the empirical probability of successful detection of an actually present 
signal, and we want it to be close to 1 (about 1 — a = 0.99). Given that p < a when 
p = 0, the performance of a test can be quantified as the smallest value p* of p for which 
p is at least 1 — a (the less is p*, the better). 

We used 4-element collections w (i.e., used d s — 4), and for every iV and p ran two 
10,000-element series of experiments differing in how we select w and z. In the first 
series ("random signals"), w was selected at random, and z was a random combination 
of the corresponding harmonic oscillations. In the second series ("bad signal") we used 
w = {0,0,0,0}, and z was the algebraic polynomial of degree 3 with the largest, among 
these polynomials, ratio of ll^ 1 lloo/lko^lh- In the latter case only the realisation of 
noise varied from one experiment to another. 

The results of our experiments are presented in table 2. They are in full accordance 
to what is suggested by our theoretical analysis; for N = 256, both tests exhibit nearly 
the same empirical performance. As N grows, the empirical performances of both tests 
improve, and the "performance gap" (which, as expected, is in favor of the basic test) 
grows. 

6 Proofs 

6.1 Preliminaries 

Notation. In what follows, for a polynomial p(() = J2T=oPk( k , we denote 

lb(-)IU = max |p(C)| 

and denote by 

\p\ s = II bo; Pi; -;Pm]|U 1 < s < oo, 

the £ s -norm of the vector of coefficients, so that 

lb(-)ll 2 2 :=^f b(C)l 2 MCI = IpII- 

The key fact underlying Theorems 3.1, 3.2 is the following 
Proposition 6.1 Let d, N be positive integers and s G Sd- Then 

\\F N s\\ y^N^Wst'lU (14) 
where c(d) > is a universal nonincreasing function of d. One can take 

c(d) = 0(l)/(rf 3 ln(2d)) (15) 
with properly selected positive absolute constant 0(1). 
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N = 256, random signals (p»(B) m 1.10, p»(E) m 1.35) : 



p 


0.00 


0.95 


1.00 


1.05 


1.10 


1.15 


1.20 


1.25 


1.30 


1.35 


1.40 


p(B) 


0.010 


0.960 


0.977 


0.987 


0.993 


0.998 


0.999 


0.999 


1.000 


1.000 


1.000 


p(E) 


0.011 


0.710 


0.779 


0.842 


0.887 


0.933 


0.956 


0.974 


0.987 


0.994 


0.997 


P 


1.45 


1.50 


1.55 




p(B) 


1.000 


1.000 


1.000 


p(E) 


0.999 


1.000 


1.000 


AT = 256, "bad" signal (p*(B) as 


2.65, p,(E) ft 2.75): 


P 


0.00 


2.50 


2.55 


2.60 


2.65 


2.70 


2.75 


2.80 


2.85 


2.90 


2.95 


p(B) 


0.010 


0.973 


0.984 


0.987 


0.991 


0.994 


0.998 


0.998 


0.999 


1.000 


1.000 


p(E) 


0.011 


0.941 


0.956 


0.971 


0.978 


0.984 


0.990 


0.993 


0.995 


0.997 


0.998 


P 


3.00 


3.05 


3.10 


) ft 0.60, p*(E) ft: 0.90): 


p(B) 


1.000 


1.000 


1.000 


p(E) 


0.998 


1.000 


1.000 


./V = 1024, random signals (p*(B 


P 


0.00 


0.50 


0.55 


0.60 


0.65 


0.70 


0.75 


0.80 


0.85 


0.90 


0.95 


p(B) 


0.010 


0.960 


0.986 


0.997 


1.000 


1.000 


1.000 


1.000 


1.000 


1.000 


1.000 


p(E) 


0.010 


0.303 


0.421 


0.559 


0.686 


0.795 


0.886 


0.938 


0.974 


0.992 


0.997 


P 


1.00 


1.05 


1.10 




p(B) 


1.000 


1.000 


1.000 


p(E) 


0.999 


1.000 


1.000 


AT = 1024, "bad" signal (p, (B) a 


i 1.40, p*(E) ft 1.90): 


P 


0.00 


1.30 


1.35 


1.40 


1.45 


1.50 


1.55 


1.60 


1.65 


1.70 


1.75 


p(B) 


0.011 


0.960 


0.980 


0.990 


0.997 


0.998 


0.999 


1.000 


1.000 


1.000 


1.000 


p(E) 


0.011 


0.505 


0.564 


0.633 


0.703 


0.770 


0.819 


0.863 


0.903 


0.932 


0.960 


P 


1.80 


1.85 


1.90 


1.95 


2.00 




p(B) 


1.000 


1.000 


1.000 


1.000 


1.000 


p(E) 


0.971 


0.987 


0.993 


0.996 


0.997 


AT = 4096, random signals (p,(B) ft! 0.30, p*(E) ft 


0.65): 


P 


0.00 


0.25 


0.30 


0.35 


0.40 


0.45 


0.50 


0.55 


0.60 


0.65 


0.70 


p(B) 


0.009 


0.931 


0.993 


0.999 


1.000 


1.000 


1.000 


1.000 


1.000 


1.000 


1.000 


p(E) 


0.009 


0.084 


0.165 


0.291 


0.472 


0.667 


0.823 


0.930 


0.980 


0.997 


1.000 


AT = 4096, "bad" signal (p„(B) ft* 0.75, p*(E) ft! 1.35): 


P 


0.00 


0.70 


0.75 


0.80 


0.85 


0.90 


0.95 


1.00 


1.05 


1.10 


1.15 


p(B) 


0.010 


0.975 


0.994 


0.999 


1.000 


1.000 


1.000 


1.000 


1.000 


1.000 


1.000 


p(E) 


0.012 


0.184 


0.223 


0.290 


0.376 


0.477 


0.567 


0.676 


0.767 


0.843 


0.899 


P 


1.20 


1.25 


1.30 


1.35 


1.40 


1.45 




p(B) 


1.000 


1.000 


1.000 


1.000 


1.000 


1.000 


p(E) 


0.945 


0.975 


0.986 


0.995 


0.999 


1.000 



Table 2: Basic test vs. Energy test, problem (Pi) with d s = 4. p(B), p(E): empirical 
probabilities, taken over 10,000 trials, of detecting signal using the basic test (B) and the 
energy test (E). p*(-); the smallest p for which p(-) > 1 — a = 0.99. 
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Proof. Let us fix s G Sd, we intend to prove that s obeys (14). Let u = {cji, ...,cUd} be a 
symmetric mod27r collection such that s G S[u], and let 



pu(0 = IK 1 - ex p{^}0, 

so that p u (A)s = 0. Let, further, M be the index of the largest in magnitude of the reals 
So, si, sjv-i, so that 

\sm\ = Hs^loo- (16) 

We can w.l.o.g. assume that M > (AT— 1)/2. Indeed, otherwise we could pass from s to the 
"reversed" sequence s' G Sd' s' t = sjv_t_i, t G Z, which would not affect the validity of our 
target relation (14) and would convert M < (N- 1)/2 into Af' = JV-l-M> (N-l)/2. 

1° We need the following technical 

Lemma 6.1 Let d be a positive integer, and let u = {i>i, ...,t>d} G O^. For ever?/ integer 
m satisfying 

m > m(d) : = dCeil (5dmax[2, i ln(2d)]) (17) 
one can point out real polynomials q(Q = Y%Li QjC^ an d r (C) = 1 + Y^j=\ r jQ such that 

i-9(C)=P«(CMC), (is) 

and 



\q\i < C7i(d)/Vm w/iere d(d) = 3ed 3/: yln(2d). (19) 
The proof of Lemma 6.1 is presented in the appendix. 

2°. The following statement is immediate: 

Lemma 6.2 Let m < (N — l)/2 7 and g G C N be such that gi = /or i > m. Let h G 
6e i/ie discrete autoconvolution of g, i.e. the vector with entries = Ylo<i j<m i+j=k 9i9j > 
< k < 2m and with zero remaining N — 2m — 1 entries. Then 

\\F N h\\x = y/N\\g\\l 



Proof. We have 



\F N h]{jj) — N 1//2 Y,0<t<2m J2o<j,k<m,j+k=t 9j9k 

= N 1 ^ 2 Y,0<t<2mJ2o<j,k<m,j+k=t(9jt l '')(9kt l ' k ) 



Invoking the Parseval identity, we conclude that 

11^11! = ^hf^i^jv 1 / 51 !!^. □ 
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3°. Let 

N > 60d 2 ln(2d), (20) 

and let 

m = Floor ( ~ ) . (21) 

Then (17) is satisfied, and, according to Lemma 6.1, there exists a polynomial = 
ET=i QjC j such that 

l-?(C)=Pu(CMC), Iffla < c t (d)/V^, 
with some polynomial r. Setting g+(C) = q 2 (() = E?=i g/C J , we get qt = Ei<i,j< m ,i +j =k QiQj 

(1 - q + (A))s = ((1 + g(A))(l - q(A))s = ((1 + q(A))r(A)p u (A)s = 0, 

whence s M = Ei=i ^m-^ (note that M > (JV - l)/2 > 2m by (21)). Let now h G R w 
be the vector with coordinates 



hi 



z = M-l,...,M-2m, 
0, otherwise. 



Note that by Lemma 6.2 and due to |g|2 < C±(d) / \fm one has 

\\F N h\\t < N l ' 2 \q\\ < C 2 (d)VN/m. 

We have 



,-ZV-l|| __ | | 
'0 lloo — |*M| 



2m 

N-l 



i=l 



\(hX )\ = \(F N h,F N s}\ < IIF^IIxllF^sl 



where the last equality is given by the fact that Fjv is unitary, whence 



771 

Halloo > H^-loo/ll^lll > n2( r^ K^Woo- 

Invoking (21), (20), and (19), we see that for iV satisfying (20) our target relation (14) 
indeed holds true, provided that 

c{d) < 0(l)[rf 3 ln(2c/)]- 1 (22) 
with properly selected positive absolute constant 0(1). 



4°. It remains to verify (14) when N < 60<i 2 ln(2cf). Since is unitary, we have 
\\sq 1 \\oo < ||s Q ||2 



■■ v_i " < \\sfi~% = \\F N s\\ 2 < WFnsW^VN, whence 



1 



\\F N s\U > N-V*\\s»-*\U > N-^ 2 \\s^\U > 6 ^ H2 ^ W 1/2 \\s^\U 
which completes the proof. □ 
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6.2 Proof of Theorem 3.1 



1°. Let us prove the result for the basic test, let it be denoted 0, as applied to the 
problem (P2)] note that (Pi) is the particular case of (P 2 ) corresponding to d n = 0. 

We have to show that under the premise of the theorem eo(<p; H ) < a and £i(<p; -ffi(p)) < 
a. The first bound is evident. Indeed, let E a = {£ : ||F/v£||oo < Qn(®)}, so that 
Prob^jv"(o,/jv){^ e > 1 — Under the hypothesis H , the set Z from (6) contains the 
true signal x^ -1 , so that the optimal value Opt 2 (y) in (5) is at most ||F/v^||oo- It follows 
that when £ G S Q (which happens with probability > 1 — a) we have Opt < ^(a), and 
the basic test will therefore accept H . We conclude that e ((p; H ) < Prob{£ ^ E a } < a. 

2°. Now let x G Hi(p), i.e., a; = s + u, where s G S[w] for some w G Qd s , u G «S[w], and 

- A%~ l \\oc >pV«€5[w]. 

Let z G «S[w], and let s = a; — 2. Then s G <S<f*, d* = d n + d s , and ||s -1 ||oo > P, whence, 
by Proposition 6.1, 

Halloo > c(d*)N 1 ' 2 \\ifl- 1 \\ 00 > c(d*)N l ' 2 p. 

It follows that the optimal value Opt(y) in (5) is at least c(d*)N 1 / 2 p — ||F/v£||oo- Recalling 
the definition of q^{ct), we conclude that 

Prob{Opt(?/) > c{d*)N 1/2 p - q N {a)} > 1 - a 

as soon as 

P > -^q N (a)VN, (23) 
c{d*) 

and the probability to reject H\(p) when the hypothesis is true is < a. Specifying c\(d*) 
as, say, 2.1c(d lt ) -1 , we see that under the premise of Theorem 3.1 one has £i(<p) < a. □ 

6.3 Proof of Theorem 3.2 

1°. We start with the following simple 

Lemma 6.3 Let d and N be positive integers, let e > ; let u = {y\, vj} be a symmetric 
mod2iT d-element collection of reals. Whenever s G <S ' e [u] ; there exists a decomposition 
w = s + z such that s 6 5[u] and 

Halloo < N d e. (24) 

Proof. Let p u (() = n^=i(l — ex P{^}C) an d r = p u (A)w, so that \\r _1 ||oo < e due 
to w G (S^^fu]. Let, further, 5 be the discrete convolution unit (i.e., 5 G S is given by 
5o = 1, <^t = 0, t ^ 0). For £ = 1, ...,<i, let 7^ be a two-sided complex-valued sequence 
obtained from the sequence {exp{zvgt}}tez by replacing the terms with negative indexes 
with zeros, and let r + be obtained by similar operation from the sequence r. Let us set 
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where * stands for discrete time convolution. It is immediately seen that x is a real- valued 
two-sided sequence which vanishes for t < and satisfies the finite-difference equation 
p u (A)x = r + (due to the evident relation (1 — exp{w fc }A)7^ fc ) = 5). It follows that 
(p u (A)(w — x))t — for t = 0, 1, which (along with the fact that all the roots of p u (C) 
are nonzero) implies that the sequence s = w — x can be modified on the domain t < so 
that p u (A)s = 0. Then z = w — s coincides with x on the domain t > 0, and w = s + z 
with s G S[u] and zt — Xt, t — 0, 1, .... It remains to note that for two-sided complex- 
valued sequences /i, v starting at t = we clearly have ||[^*^]o^ -1 ||oo < ll/- t o' _1 ||i|l I/ o^ _1 ||oo- 
Applying this rule recursively and taking into account that || h 7 ^]^ -1 ||i = N, we get the 
recurrence 

|| [ 7 W * ... * 7 <*+U * |U < iV|| [ 7 W * ... * 7 W * r +]^-i 1^, £ = 0, 1, - 1, 

whence || Xo^~ 1 II oo < iV d e. Since 7 t = Zt for t = 0, 1, (24) follows. □ 

2°. We are ready to prove Theorem 3.2. It suffices to consider the case of problem (iV 2 ) 
(problem (iVi) is the particular case of (AT 2 ) corresponding to e s = 0). The fact that for 
the basic test (p one has £o(</>) < at can be verified exactly as in the case of Theorem 3.1. 
Let us prove that under the premise of Theorem 3.2 we have £i((p) < a as well. To this 
end let the signal x underlying (1) belong to Hi(p), so that x = r+u for some u G S N,<Ln [w] 
and some r G 5^™^] with d n -element collection w and <i s -element collection w, both 
symmetric mod27r. Let also z G «S ' £n [w]. Since x G Hi(p), we have 

\\[x - z^Wov > p. (25) 

Applying Lemma 6.3 to r, u, z, we get the decompositions 

x = s + s' + v' : s G <S[w], s' G S[w], IH^loc < + N d "e 8 , 

z = s " + v " : s " G S[w], IIKI^IU < N d -e n , 
=3- w := x — z = s + v, (26) 
s = s + s' - s" G 5[fUw], 



7T.N-1\ 



V, 







< a := 2N d "e n + N d °e s . 



Now, (25) implies that ||w || > p, whence, by (26), 

lls^loo >P-=p-cr- 

Assuming that p > 0, noting that s G <S[w] for (d* — d n + d s )-element symmetric mod27r 
collection w and invoking Proposition 6.1, we get 

Halloo > c(d*)N 1/2 p. 

Taking into account that H-F/v^Hoo < ll^o 1 ||2 < ^^ll^o^lloo and (26), we get also 
[1-Fjv^IIoo — N l l 2 a. Combining these observations, we get 

PMx-zlHoo = WFns + FnvWoo > IIFjvsIIoo - \\FnvWoc > c{d,)N^ 2 p- N l ^ 2 a 
= c{d*)N 1 ' 2 [p-a]- N^a = c^N 1 ' 2 \p - [1 + c;\d*)\a . 
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Since z G 5 W,€ " [w] is arbitrary, we conclude that the optimal value Opt(?/) in (5) is at 
least $ — H-F/v^lloo, so that 

Prob{Opt(y) > $ - q N (a)} > I - a. (27) 

It remains to note that with properly selected positive absolute constants 0(l)'s in (7) and 
(8), these restrictions on p, e n , e s ensure that $ > 2q N (a) (see (26), (15)), and therefore 
(27) implies the desired bound £\{(p) < a. □ 



6.4 Proof of Proposition 4.1 

Here we prove the lower resolution bound for problem (P2). The result of the proposition 
for the setting (Pi) may be obtained by an immediate modification of the proof below for 
d n = 0, Pw(-) = 1, and z = 0. Below we use notation re* for positive absolute constants. 
1°. Note that for every integer d s > there exists a real polynomial qd s on [0, 1] of 
degree d s — 1 such that f q% s (r)dr = 1 and max < r <i \qd s (r)\ = q<i s (^) = d s - 5 Let q = 

|g t = ^ _1//2 fe(^/^)} i > ^ > 0) an d consider the two-sided sequence 



1 +0O 



x = [x t = e N \(-iyq t ] 

where 9^ > is chosen in such a way that 

IFo 1 1 52 — A 

Note that 6V given by this requirement does not depend on A and that 6 N — > 1 as N — Y oo 
due to Jq ql s (r)dr = 1. We have 

\x N ^\/\\x»-% -> = 4 as iV -> oo. (28) 

VJo ?2.Wdr 

The derivative q' da (r) of the polynomial satisfies 

max |4(r)| < 2(d s - l) 2 max |g ds (r)| < 2d 3 s 

0<r<l s 0<r<l 

(the first inequality in this chain follows from brother Markov's inequality). We conclude 
that for properly selected K\ > 1 and all iV > Kid 2 (d n + 1) it holds q^t/N) > d s /2 
whenever N — d n — 1 < t < N — 1. Taking into account that 6^ — > I as N — » oo, it 
follows that for properly selected co(d s , d n ) > Kid 2 a (d n + 1) and all iV > co(d s , d n ) it holds 

N-d n -l<t<N-l=>\x t \ = (-l) t x t , , , 

minjv-^-i^jv-i \x t \ > \x N -i\/2 > ^OnXN' 1 / 2 d s > K 3 \N-^ 2 d s 1 ' 



5 In fact, k + 1 is the maximal ratio of the uniform, on [0, 1], norm of a polynomial of degree < k and 
the £2(0, l)-norm of the polynomial. 
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(Is 

Beside this, for every d s and N, we clearly have x G S[w] with w = {tF^~k} (indeed, 
for all t G Z, ((1 + A) d °x) t = (-1)%A((1 - A) d *g)t = 0). 

2°. Let w = {0, 0}, with Pw(C) — (1 — C) dn - Assuming N > c (d s , d n ), we have 
|(Pw(A)x)jv_i| > 2 d " min > 2 d ' l K 3 AA^~ 1/2 4, 

N—d, n — l<t< : N— 1 

so that for every 2 G <S[w] we have 

|(?%(A)[5 - > 2 d ^ 3 AiV- 1 / 2 4. 

Since iV — 1 > d n , when taking into account that |pw|i = 2 d ™ we get for any z G «S[w] 
2 d "||[a;-^^- 1 || 00 = IPwIip-^lloc > |(Pw(A)[ac-2]V_i| > 2 d "K 3 \N~ 1 / 2 d s , 
whence 

V«GS[w]: ll^-^^IU > n 3 \N- 1/2 d s . (30) 



Now let us set A = K 4 ym(l/a), with the absolute constant k 4 selected to ensure that 

A < 2ErfInv(ai). The latter relation, due to A = ||2;^ _1 || 2 , ensures that the hypotheses 
"observation (1) comes from x = 0" and "observation (1) comes from x = x" can- 
not be distinguished (1 — a)-reliably. Thus, (30) implies the lower resolution bound 

KzKidsN~ 1/2 Jhi{l /a) . □ 



6.5 Proof of Proposition 4.2 

In the reasoning below, q denote positive quantities depending solely on d = d n , and k 
denote positive absolute constants. We start with proving the claim (ii). 
1°. Let us set 

' IX 7T t 



Assuming Co > 40c?, see (9. a), let us fix an integer r such that 

d-l <r < (N-l)-20d (32) 

and set 

7 = 7t,n = ef;\ f = 7 /. (33) 

By the definition of / we have 

< ft < e for < t < r, (34) 

and 

e + K N- l (t -r)e< f t <e + ^N'^t - r)e for r < t < N - 1. (35) 
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Let p(Q = (1 — () d — Pw(0- We clearly can find a sequence x = {x t = a cos(|£ + b)} c j^_ 00 
such that p(A)x = f, and, due to d s > 2, we have x G Sd s - Further, let z G <S satisfy 
z t = x t for < t < t, and 

[ft, 0<t<r, 
(p(A)z) t = 0, t < 0, 
[e, t>r. 

Note that z is well defined due to p(A)x = f, and, taking into account (33) - (35), we 
conclude that z G 5 e [w]. 

2°. By the above construction, the sequence 5 = x — z is such that (p(A)5) t = for 
< t < r, and K (t - ^N^e < (p(A)5) t < K X {t - r)N~ l e when r < t < N, see (35). 
Besides, S t = when < t < r. By evident reasons, these two observations combine with 
the first inequality in (32) to imply that 

||^" 1 ||oo<c 4 (iV-r) d+1 iV- 1 e. (36) 

for some c\ > depending solely on d. We conclude that 

\\6t% < ll^llooVOv^F < c 4 (iV - Tf+^N-h. 

Now note that the hypotheses "observation (1) comes from x = z" and "observation 
(1) comes from x = z + 5" cannot be distinguished (1 — a)-reliably unless \\5 _1 ||2 > 
2Erflnv(a) > J k 3 ln(l/a). Equipped with this k 3 and with c 4 participating in (36), let 
us set 

v = Floor (Jk 3 ln(l / a) N 2 cfe~ 2 ) ^ . (37) 

It is immediately seen that with properly chosen positive c\, C3 depending solely on d, and 
with e satisfying (10), we have 20d < v < N — d, so that setting 

T = N-u, 

we ensure (32). From now on, we assume that c%, C3 are as needed in the latter conclusion. 
With the just defined r, we have \\S < K^\n(l/a), meaning that x and z cannot be 
distinguished (1 — a)-reliably. 

3°. To prove the claim (ii) it now suffices to show that a properly chosen C5 > 0, depending 
solely on d, 

Vz G S € [w] :\\[x- zJ^Hoo > c 5 (N - rf^N^e = c^N^e. (38) 
Indeed, given z G S e , we have 

T <t<N^ (p(A)[x - z]) t = (p(A)x) t - (p(A)z) t >f t -e> n N^e(t - r), 
with concluding inequality given by (35). Setting 9 = [(N — 1 — r)/2j, the sequence 

s t = (x - z)t- T , t ez 
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satisfies 

(p(A)s)t > K 2 9N-h, 9<t<29, (39) 

and, by the right inequality in (32), 9 > lOd. Setting k = [(9 — d) / d\ > 2, consider the 
polynomial 

d(fc-l) 

g(0 = (i - C fe ) d = (i - C) d (i + C + - + C^Y = (i - C) d E 

' r: ' i=° 

where, clearly, 

«i>0, E^' = ^- (40) 

Let now r = g(A)s. Taking into account that \q(- )|i = 2 d , we have 

r 2e < 2 d \\sf\\ 00 <2 d \\[x-z}^ 1 \\ 00 , (41) 

since, by construction, || [x— z}^ 1 > ||s^||oo- On the other hand, r = v(A)u, u = p(A)s, 
so that 

d(fe-l) 

r 2 e = E u i«2«-i- 
i=o 

By (39), we have u 2 e-j > K 2 9N~ 1 e for < j < d{k - 1) (note that d{k - 1) < 9), and by 
(40), 

r 29 > KiON-h^Vj = k d K 2 9N- 1 e. 

j 

Combining the latter inequality with (41) we come to \\[x — 2]o r ~' L || D c > n 2 2~ d k d 9N~ 1 e. 
Recalling that by construction k > K\o{N — r)/d, 9 > Kn(N — r), we arrive at (38). (ii) 
is proved. 

4°. It remains to prove (i). Note that when e < ci2iV~ 1//2 yin(l/a:), the conclusion in (i) 
is readily given by a straightforward modification of the reasoning in section 6.4. Note 
that for the time being the only restriction on the lower bound Cq on N, see (9. a), was 
that Co > 40cf, see the beginning of item 1°. Now let us also assume that N is large 
enough to ensure that C\ 2 N~ 1 / 2 > c^N^^ 1 ^ 2 (which still allows to choose Co as a function 
of d — d n only). With the resulting cq, the range of values of e for which we have justified 
the conclusion in (i) covers the corresponding range of e allowed by the premise of (i). □ 

6.6 Proof of Proposition 4.3 

The proof of the statement (i) is given by a straightforward modification of the reasoning 

in section 6.4. Let us prove (ii). Let w = {it, 7r}, and < t < N — d n — 1, so that 
cv^ 3 [w] contains the sequence x = {x t = Cie s (— 1)*(£ — t)+}'£L_ 00 with < C\ = Ci(d s ) 
small enough. Then for w = {0, ...,0} (d n zeros), with Pw(C) = (1 — C) d ") we have for any 
z E S N ' 6n [w]: 

|(Pw(A)[x - z])n-i\ > \(pw(&)x)n-i\ - \{pw{A)z) N - 1 \ > 2 dn \x N - d ^ 1 \ - t n 

> c 2 e s (N-T) d ° -e n , 
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where c 2 > depends only on d s and d n . Therefore, when denoting v = N — r, for every 
z G S ' e "[w] we have 

2 dn \\[x - z]^ 1 ^ = |Pw|i||[^-^]^ _1 ||oo > |(pw(A)[z-z]Vi| > c 2 e s v d ° - e n , 
whence, 

G S N '^[W] : || [x - > 2- d "{c 2 e s v d ° - e n ). (42) 

It is immediately seen that with properly selected positive q = Ci(d n ,d s ), i = 3,4,5,6, 
assuming 



e s N d ° + 2 > c 3 Vln(l/«) & e s < c^ln(l/a) (43) 
and selecting r according to 



i 

2d s + l 



v = N — t = Floor (^c 5 [ej 2 ln(l/a 

we ensure that 0<r<N — d n — 1 and 

(a) r < N -d n -l, (b) \\x$-% < 2ErfInv(a 



i 



(c) 2- d »(c 2 e s z/s - e n ) > p := c 6 el ds+1 (ln(l/a))^+r, 

(when verifying (c), take into account that < e n < e s ). By (b), the hypotheses "ob- 
servation (1) comes from x = 0" and "observation (1) comes from x = x" cannot be 
distinguished (1 — a)-reliably, while (42), the already established inclusion x G S ,e "[w] 
and (c) imply that x obeys the hypothesis Hi(p) associated with the problem (N 2 ). The 
bottom line is that in the case of (43), p defined in (c) is a lower bound on p*(a). □ 
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A Proof of Lemma 6.1 

1°. Let A e C, < |A| < 1, let e G (0, 1), and let n > 1 be an integer. Setting 5 = 1 - e, 
consider the polynomials 

A(C) = f k (z;X,e):=(l-XOEtomY = ^t z [l-[SK] k+1 ], A; = 0,1,... 

Pn (() = p B (z;A ) e):=iE^ 1 /*(C) = (l-AC)ES[*ACHl-^/n] 1 ' 

Observe that 

/ fc (0) = l,/*(l/A)=0, 

whence 

p n (0) = 1, p„(l/A) = 0. (45) 

1.1°. Let us bound from above the uniform norm ||p n (-)||oo of p n on the unit circle. We 
have p n (C) = r n (AC), where 

r n(C) = ^(1 — C)Ea=0 1-5C = (! ~ n(l-SC) 

1-C n(l-60-6(+[6(} n+1 

9n(0 h n (0 
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Since |A| < 1, we have |bn(-)||oo < |bn(-)IU||^(-)IU- When |(| = 1, we have 

I <r\\ 1 ^-Cl < 1 



(46) 



If we set ( = cos(0) + i sin(0) , and e = 9/n and 5=1 — e = l — 6/n with some 9 G (0, n) 
we obtain 



MO I < 



n+l 



\n(l-5Q-5(\+5 
n\l -5\\ 

n-(n + 1)5 cos(»] 2 + (n + 1) 2 5 2 sin 2 (0) + 5 n+1 



n\J[l - 5 cos((j))} 2 + 5 2 sin 2 (0) 
^n 2 + {n + 1) 2 5 2 cos 2 (0) - 2n(n + 1)5 cos(0) + (n + 1) 2 5 2 sin 2 (0) + <5 n+1 

nyl + <5 2 cos 2 (0) - 25 cos(0) + 5 2 sin 2 (0) 
^/n 2 + (n + l) 2 - 2n{n + l)5cos(0) + 5 n+1 







yi + 5 2 -25cos(0) 


^[n - (n + 1)5)] 2 + 2n(n + 1)5[1 - cos(0)] + 5 n+1 


n^l - 5] 2 + 2<5[1 - cos(0)] 




'Qn+l _ { 

n 


2 + 2(n + l)(n - 0)[1 - cos(0)] + 5 n+1 




Tly 


/ 5 + 2n- 1 (Ti-^)[l-cos(0)] 




'gn+i _ { 

n 


2 + 2(n + l)(n - 0)[1 - cos(0)] + 5 n+1 



2 + 2n(ri-0)[l-cos(</>)] 



y/JT+Td 



where 



a 



flzthl _ i 

n 



(47) 



,/3 = 2(n+ l)(n - 0), 7 = 5 n+1 , ^i = 9 2 ,v = 2n(n - 9), 

t = 1 — COS(0) 

It is immediately seen that with positive a, /3, 7, \i and 1/ such that 

n/v > a/(3, (48) 

the maximum of the function ^^f^" 7 over t such that a + /3t > is achieved when 



cx 



+ pt = and is ec i ual t0 V f V 1 + 



/3fi—au ' 

1 < 9 < n. 



Now, assume that 



(49) 



Then ^9 2 > [02±i - l] 2 , so that the parameters a, 1/ defined in (47) satisfy (48). We 
conclude that 



\K 



< 



ln + 1 



n 



\ 



1 



[1 - 9/n} 2 ( n + l ) 



n+l 02 _ Q n+1 _ 1 
n n 



2 ' 



(50) 



26 



Note that 



when 9 satisfies 



- 1 > 1 



n 



n 



n 



2n 
n + 1 



<9 < 71, 



and (50) implies in this case that 



IIMOIloo < ^^V 1 + [ 1 -W (n+1) ^ ex P + 2 e_29 } • 

The latter bound combines with (46) to imply that in the case of (51) (recall that 1 
e = 0/n) we get for all |A| < 1: 

max|p„(z;A, £ )| < j^H^ + r" 29 



1.2°. Now let us bound from above ||1 — p n {-)\\2- We have 



*(0 = i+££i l (* 



6 



i-i 



Taking into account that |A| < 1, we conclude that 



n-l 



pn(-)h < iiE( i -^ le [ i --][Acni2+-iiE( i -^ 1 [Acni 2 

1=1 "' lh 1=1 



< 



< 



V; e2 (l_e)^-i) + > /l/n 
\ i=i 



\i i_(i_ e) 2 + v /1 /™<v / ^+y-< 2 i/ max 



n 



2°. Let n = [m/d\ and Xg = exp{— ivi}, 1 < I < d, where m, d and t>i, ...,1^ 
described in the premise of the lemma. Let us set 

1 6 
6 = max[2, - ln(2d)] < 3 ln(2d), e = -, 

9(C) = 1 ~Pn(z; Ai,e) -j) n («; A 2 ,e) • ... -p n (A d ,e). 
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2.1°. Observe that by (17) we have 

n > n(d) := Ceil(5d0) = Ceil(5dmax[2, - ln(2d)]). (54) 
Our choice of 6 and n ensures (51), so that < e < 1, and by (52) we also have 

max\ Pn (z;\ e ,e)\ < exp \— + ^ + \e-2e\ < e 1 ^, (55) 
|z|<i [ n — In 2 J 

where the concluding inequality is readily given by the choice of 9 and by (54). Recall 
that by (44), p n (z; Xe, e) is divisible by (1 — \e(); when setting 

r/(C) = P f'' YJ 1 = EK1 " e)A*C]'[l - t/n], 
and r(£) = n|=i r ^(0? we clearly have r(0) = 1, degr < d(n — 1) < m — d, and 

i-g(C)=P«(C)n^(0=p«(CMC), 

as required in (18) (note that q is a real polynomial due to u G {Id)- 

2.2°. By (55) we have \\p n (-; e, A fc )||oc < e 1 ^, while (53) says that 

|b n (-;Afc,e)-l|| 2 <30n(2d)/n. 



We have 



1 - Y[Pn(-;^k,e) 

k=l 



1 - II Pn(-; Afc,e) 
fc=l 



p n (-; A m , e) + [1 - p n (-; A|+i, e)]. 



When denoting = ||1 — n Pn(s Afc,e)||2 for £ = 1,2, and setting a = 0, we get 



k=l 



a i+ i < atWpn^Xt+ue)^ + \\Pn{-, Xi+i, e) - 1|| 2 < a £ e 1/d + 3^/ln(2d)/n, < £ < d. 



It follows that < 3£y lD ^ e e ^ d when £ < d, which implies 

||g(.)||a < 3edyjln(2d)/n < 3ed 3 /\^ 1 ^. 

and (19) follows. □ 



rn 
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